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ABSTRACT 

Widely used measures of creativity are reviewed and 
classified into ten categories: tests of divergent thinking; attitude 
and interest inventories; personality inventories: bioqraphical 
invertories; teacher rioainations ; peer noninaticns; superviscr 
ratings; ludgments of products; noBination of eminent persons; and 
self -reported creative activities and achievenent. Judgments by 
peers, supervisors, or teachers are hampered »iy low inter-judge 
reliability, halo effects, and low discriminant validity, 1 a latter 
problem is due to an inability to distinguish creativity from other 
constructs such as intelligence or achievement: or the inability to 
discriminate among dimeiisions . of creativity, such as fluency, 
flexibility and inventiveness. Tests and inventories are best 
described as correlates of real life creative 'behavior ; they explain 
somethir'' about the behavior, but are not acceptable for selection- 
The most serious measurement problem is a lack cf convergent validity 
among all these methods-^correlations between methods are low, A 
simple and straightforward inventory of creative achievement appears 
to te the best measure because it is direct, observable, and 
validated in research as the best predictor of future creative 
behavior. (Authoj/CP) 
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Abstract 

Presently available criteria of creativity are reviewed and 
classified into ten categories: tests of divergent thinking, 
attitude and interest inventories, personality inventories, bio- 
graphical inventories, teacher nominations, peer nocinations, 
supervisor ratings, judgments of products, eminence and self- 
reported creative activities and achievements. These techniques 
for measuring creativity are th i criticized in terms of their 
reliability, discriminant validity, dimensionality and convergent 
validity. It is concluded that an inventory of self-reported 
creative activities and accomplishments is the most defensible 
technique for selecting creative individuals. 
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Perhaps no pi^ychological concept has proven to be as diffi- 
cult to measure as creativity, A wealth of research in the last 
twenty-five years has included the development: of nymerous in- 
struments which are used in the identification of creative 
talent (see Davis, 1971; Kaltscunis, iWl, 1972), The most 
salient characteristic of these instruments is their diversity. 
This diversity is indicative of both the complexity of creativity 
and the multitude of goals, research designs, subjects, settings, 
etc. that are characteristic of research on the psychology of 
creativity. Understandably, a number of experts in the area have 
suggested that the measurement of creativity be given more atten- 
tion (Delias & Gaier, 1970; Treffinger & Poggio, 1972; Treffinger, 
Renzulli & Feldhusan, 1971; Yamaraoto, 1965). 

Hopefully, some of the confusion regarding creativity can be 
dispelled by classifying many of the existing criteria. Accord- 
ingly, the different approaches to identifying creativity will be 
categorized into ten groups. These ten categories are meant only 
to be descriptive, so consequently, they are neither final nor 
mutually exclusive. Following these descriptions, a general cri- 
tique of tha existing criteria of creativity will be provided. 
Tests of Divergent Thinking 

Describing creativity in terms of divergent thinking is the 
nost widely used approach to studying creativity* On the basis 
of Guilford^s (1956) structure of the intellect model and over a 
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decade of factor analytic research, Guilford and his colleagues 
have Identified various Intellectual abilities. Some of these 
abilities (e.g., fluency, flexibility, originality, redefinition, 
elaboration, etc.) have been collectively labelled divergent 
thinking. ^ A wide variety of tests have been developed by 
Guilford and his colleagues to measure divergent thinking, such 
as Alternate Uses (Christensen, .Guilford, Merrifield & Wilson, 
1960), Plot Titles (Berger & Guilford. 1969) and Consequences 
(Christensen, Merrifield & Guilford, 1958). Tests of divergent 
thinking are distinguished from traditional intelligence tests in 
that they require a multitude of responses, rather than a single 
correct answer. For example, in the Alternate Uses tests, sub- 
jects are asked to think of alternate uses for a variety of 
common objects (e.g., shoe, pencil, etc.). Similarly, in the 
Plot Titles test, subjects are asked to generate clever titles 
to two stories. 

Guilford (1968) and others (To,rrance, 1974; Wallach & Wing, 
1969) have suggested that the more crea^rive individual should 
possess the types of abilities measured by tests of divergent 
thinking, and the. Guilford trsditior. has had considerable impact 
on the study of creativity. A number of investigators have de- 
veloped assessment devices (e.g., Getzels & Jackson, 1962; Gough, 
1975, 1976; Industrial Relations Center, 1959; Lawshe & Harris, 
1960; Mednick, S. & Mednick. M. . 1907; Torrance, 1974; Wallach & 
Kogan, 1965) which may be considered modifications of the Guilford 



Measurement of Creativiv:y 

A. 

tests of divergent thinking. 
Attitude and Interest Inventories 

Some Investigators have suggested that creativity can be 
identified in terms of interests and attitudes. This approar.h 
is based on the assumption that a creative person will expreiis 
attitudes and interests favoring creative activities. For ex- 
ample, the Guilford-Zimmerman Interest Inventory (Guilford & 
Zlimaerman, 1963) contains a "creative interests" scaJe. In this 
test, subjects are asked to indicate their interest in a vide 
variety of activities. As reported by Taft and Uilchrist (1970), 
a creative individual would indicate interest in items like ihe 
following: 

Formulate a new theory to replace one that has been 

accepted for years. 
Invent a new gadget. 

Write words in new combinations to convey emotion 
rather than meaning. 

Think up plots for novels. 
Similarly, on the Holland and Baird (1968) Preconscious Activity 
Scale, individuals high on originality agree with items like the 
following: 

I would rather be a research engineer than an industrial 
engineer. 

I often daydream about unsolved problems. 
I have to learn things in my own way rather than accepting 
Ideas or relationships suggested in textbooks, etc. 
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If I had the necessary talent, I would enjoy being a 

sculptor. 
I often act without thinking. 
I would like to be an inventor. 

The Study of Values (Allport, Vernon & Lindzey, 1960), a 
scale developed to measure basic interests and motives, has been 
used to assess creativity by the Institute of Personality Assess- 
ment and Research and the Center for Research and Development, 
both at the University of California at Berkeley (Heist, 1968), 
Researchers at these two institutions believe that a certain pat- 
tern of values typically discriminate the creative individual. 
The pattern consists of very high scores on the AVL's Theoretical 
and Aesthetic Scales, and very low scopes on the AVL's Economic, 
Religious, and Social Scales (Heist, 1968) . 

Other attitude and interest inventories which are purported 

to be useful in studying creativity are the Runner Studies of 

Associates , 

Attitudinal Patterns (Runer^ 1954) , the Childhood Attitude In- 
ventory for Problem Solving (Covington, 1966), the Creative Be- 
havior Disposition Scale (Taylor, I., Sutton & Haworth, 1974), 
Creative Attitude Survey (Schaefer & Bridges, 1970), and the 
Opinion, Attitude, and Interest Survey (Fricke, 1965). 
Personality Inventories 

Some investigators have characterized creativity as a set of 
personality factors rather than cognitive traits. Consequently, 
several well known personality inventories have been scaled to 
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identify creativity. For example, in at least four studies, the 
Adjective Check List (Gough & Heilbrun. 1965) has been suggested 
as a potential measure of creativity (Domino, 1970; Lacey & Erick- 
aon. 1974; Smith & Sch^efer. 1969; Welsh, 1967). Some representa- 
tive adjectives common to the first three of these studies are: 
clever, complicated, cynical, imaginative, original, reflective, 
and unconventional (Yarnell, 1971). 

Additional personality inventories which have been adapted 
to Identify creativity are Heist and Yonge's (1968) Omnibus Per- 
sonality Inventory (Heist, 1968), Cough's (1957) California Psy- 
chological Inventory (Helson, 1965), Barron's (1953) Independence 
of Judgment Scale (Schmeidler, 1965), and R. Cattell and Eber's 
(1968) Sixteen Personality Factor Questionnaire (Cattell, R. & 
Butcher, 1963). Finally, Torrance and Khatena (1970) have de- 
signed a personality inventory specifically for identifying cre- 
ative adolescents. Items on the "What Kind of Person are You?" 
instrument call for the test taker to select characteristics in 
a forced-choice format. For example, the creative person will 
describe himself as curious rather than self confident, a self- 
starter rather than obedient, intuitive rather than remembers 
well, and altruistic rather than courteous. Holmes (1976) has 
also developed a questionnaire measure of the creative 
personality. 

Biographical Inventories 

With the assumption that an individual's present behavior is 
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determined by past experiences, biographical inventories have 
been used to assess creative talent. A number of studies indi- 
cate that ''tailor-made^^ biographical inventories can predict 
creativity in an industrial setting (Buel, 1965; Buel, Albright 
& Glennon, 1966; McDermid, 1965; Owens, Schumacher & Clark, 
1957). 

Two published inventories with more applicability are presently 
available: the Alpha Biographical Inventory by the Institute for 
Behavioral Research in Creativity (1968) and Schaefer's (1970) 
Biographical Inventory: Creativity. The Alpha Biographical In- 
ventory is the result of an extensive research program carried 
out with NASA Scientists and engineers (Taylor, W. , & Ellison, 
1964) and, consequently, it is limited to measuring creativity in 
the scientific areas. It consists of three hundred items which 
cover a wide variety of areas such as hobbies, interests, child- 
hood activities, self-ratings, experiences, etc., and it can be 
scored for both creativity and academic performance, 

Schaefer's (1970) Biographical Inventory: Creativity is 
similar in nature but broader in applicability. One hundred and 
sixty-five questions are grouped into five sections: physical 
characteristics, family history, educational history, leisure- 
time activities, and a miscellaneous category. The inventory has 
several dimensions measuring different fields of creative endeavor. 
Boys are ranked on a math^science dimension and an art-writing di- 
mension. Girls are ranked on a writing dimension and an art di- 
mension. Several validation studies have been conducted using 



9 



Measurement of Creativity 

8. 

this instrument (Anastasi Schaefer, 1969; Schaefer, 1969; 
Schaefer & Anastasi, 1968). 
Teacher Nominations 

A large portion of the research on creativity takes place in 
educational settings. Accordingly, teacher ratings are a commonly 
used criteria of creativity (e.g., Foster, 1971; Haddon & Lytton, 
1971; Piers, Daniels & Quackenbiish, 1960; Richards, Cline & 
Needham, 1964; Yaraamoto, 1963). 

At the elementary school level, Yamamoto's (1963) work is il- 
lustrative. Yamamoto first established standards for teachers to 
use in their ratings. These standards usually involved identify- 
ing the most and least creative thinkers in the cl^ss. Creative 
thinking was defined as fluency (lots of ideas) , flexibility (many 
different ideas). Inventiveness (inventing and developing ideas), 
originality (unique ideas), and elaboration (detailed ideas). 
Nelson (1963) used a different approach to obtain teacher nomina- 
tions. Nelson compiled a list of personality traits which were 
cited in the research literature as characteristic of the creative 
personality. This list was then used as a checklist for teachers 
to use in making their judgments. 

Teacher nominations have also been used at higher educational 
levels. Drevdahl (]956) asked faculty members in an arts and 
science department to rate their students on a seven-point scale 
of creativity. The raters were ask°d to make two judgments: one 
based on their own definition of creativity and one based on 
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Drevdahl'a definition. No significant difference between the de- 
fined and undefined ratings were found. In an art school setting, 
Getzels and Csikszentmihalyi (Note 1) directed the art teachers 
to rate their students on a four-point originality scale where 
originality was defined as the "ability to originate ideas and to 
draw on personal resources in preparing assignments (p. 27)." 
They also had the teachers rate the artistic potential of the stu- 
dents where artistic potential was defined as the "capacity for 
growth and development of innate talent in pursuit of positive 
professional success in chosen field (p. 27)." A composite of 
these two ratings was used as a measure of creativity. At the 
secondary school level, Rivlin (1959) had 25 teachers attend a 
training conference in which a total of 14 creativity rating 
standards were discussed. On the basis of these standards, teacher 
were asked to select five intelligent, creative students and five 
equally able noncreative students from their classes. 

Teacher ratings have also served as criteria on the valida- 
tion of a number of creativity tests such as Mednicks' (1967) 
Remote Associations Test OCarlins, Schuerhoff & Kaplan, 1969; 
Mednick, M. , 1963) and Schaefer's Biographical Inventory: Cre- 
ativity (Schaefer, 1969; Schaefer & Anastasi, 1968). 
Peer Nominations 

While recognizing some inherent limitations in using peer 
nominations as a criteria of creativity, Torrance (1974) has sug- 
gested that they may provide some useful data in the study of 
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creativity. In order to eliminate the ambiguity in peer nomina- 
tloas. Torrance (1962) instructed young children to base their 
nominations on specific criteria such as ideational fluency, un- 
usual ideas. probl.r> solving ability. inventiven...ss . and so on. 
Yamamoto (l96Aa. b). Foster (1971) and Reid. King and Wickwire 
(1959) have also used peer nominations as a criteria of creativity 
and have developed questionnaires which included similar 
guidelines . 

Surprisingly, peer ratings are generally used with children 
although there are some exceptions. In working with research sci- 
entists, Taylor. C. Smith and Ghiselin (1963) obtained six cre- 
ativity ratings, rankings, and nominations by peers in a research 
lab. Sprecher (1964) acquired peer descriptions on twelve char- 
acteristics taken to identify creative engineers. These charac- 
teristics included: skill in reporting results to others, per- 
sistence, likes unusual and challenging problems, analytic thinking. 
is able to reach a decision on his own. fluency of ideas, working 
energetically, knows subject matter, friendly relations with co- 
workers, foresight, develops original approaches to problems, and 
develops valuable and worthwhile ideas. 
Supervisor Ratings 

Particularly in industrial settings, supervisor ratings have 
proven to be a useful method of choosing creative employees (An- 
drews, 1962; Meer & Stein, 1955; Taylor. C. , 1958). Supervisors 
have the advantage of being familiar with the work of many indi- 
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viduals and of having the expertise to judge the work of these 
individuals. 

Buel (1960) asked research supervisors in a large oil company 
to anonymously describe the most and Uast creative research men 
under their sunervision. On the basis of their descriptions, Buel 
developed a list of creative behaviors which he says can be used 
as a descriptive checklist for helping supervisors identify cre- 
ative research personnel. Taylor and his colleagues at the Insti- 
tute of Personality Assessment and Research have also employed 
supervisor ratings in their research with scientists in a govern- 
ment research lab (Taylor, C. , Smith & Ghiselin, 1963). Iimnediate 
supervisors were asked to rate scientists on a number of traits 
including: productiv ty, drive, mathematical ability, integrity, 
desire for facts, independence, informative ability, flexibility, 
persistence^ cooperation, and creation. Taylor also asked labo-- 
ratory chiefs (higher-level supervisors) to rate scientists with 
the aid of several checklists. 
Judgment of Products 

It is self evident that creative people should produce cre- 
ative products. Understandably, identifying creative people in 
terms of one or more . products is an approach that has encompassed 
Irtually all areas of study and a varied sample of populations, 

A J it tie known but ambitious example of this approach is a 
battery of tests developed by Foster (1971). Foster's assessment 
devices involve a broad range of activities typically associated 
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vith the secondary school. A brief description of these activi- 
ties and their corresponding areas follows: 

!• Sorting playing cards in sets of six that belong 

together (mathematics) . 
2. Creating mathematical equalities with a given set of 

numbers and symbols (mathematics). 
3* Working in a physical education class with and without 

equipment (physical education). 
4, Playing charades with several pieces of equipment such 

as masks, hats, tools, etc. (drama), 
5* Writing a story (literature). 

6. Making a model out of one or several materials such as 

buttons, feathers, wire, glue, corks, cloth, etc. 
(model-making) . 

7. Listening to music and painting a picture of what the 

music brings to mind (music) . 
Each of these products were then rated using guidelines which were 
generally based on three criteria: fluency, flexibility and 
originality. 

Most of the studies incorporating judgments of products have 
not been as broad as Foster ^s work. Usually, they have been 
limited to Judgments of a product in a single area sycli as art 
(e.g., Brittain & BeitteJ , 1964; Csik^zentraihalyi & Getzels, 1970; 
Jones, 1964; Wallbrown, J972), literature (Jones, 1964; Lynch & 
Raufman, 1974; Rookey, 1974; Wallen & Stevenson, 1960), and science 
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(Harmon, 1963; Pelz, 1963; Taylor, C, Smith & 

Ghiselin, 1953). In addition, products are sometimes defined 
less concretely as ideas (Graham, 1965; Ward & Cox, 197A). 

The judges in product studies vary from experts to nonexperts, 
and the criteria vary from diverse definitions of creativity to 
social recognition (i.e., rewards, publication, etc.). Further- 
more, subjective judgments are usually made on what products to 
choose and in what situation they will be obtained. Consequently, 
the products generally represent very narrow samples of behavior. 
Eminence 

An impractical but valuable approach to the study of creativity 
is to study eminent people. Perhaps the most noteworthy research 
of this type is the work done at the Institute of Personality 
Assessment and Research (Barron, 1969; Hall & MacKinnon, 1969; 
Helson, 1971; Helson & Crutchfield, 1970; Mackiunon, 1962). The 
IPAR group initially asked a panel of professors of architecturt- 
to nominate the forty most creative architects in the United 
States. On the basis of these nominations, sixty-four architects 
were asked to visit Berkeley for a weekend of intensive study at 
IPAR. Forty of these architects accepted. At IPAR, gmups of 
creative writers and creative mathemeticians were also selected 
by a similar process. 

A number of other studies have attempted to identify men of 
eminence. Cox (1926) used J. Mck. Cattell's (1903) list of the 
one thousand most eminent individuals in history. Cattell's 
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criteria of eminence was space accorded to each one in biograph- 
ical dictionaries. Ellis (1904) based his definition of eminence 
on space devoted to individuals in the Dictionary of National 
Biography, a British anthology of eminent people. Cattail, R. 
and Drevdahl (1955) selected eminent researchers, teachers, and 
administrators in the social sciences and physical sciences on 
the basis of committee selections and membership in a profes- 
sional society. Roe (1951a) selected a group of physical sci- 
entists by asking a committee of scientists to rate a total of 
69 men on a three-point scale of excellence. Roe also chose a 
group of eminent biologists through a similar means (Roe, 1951b). 
In Ireland, Barron (1969) asked the staff of the Irish Management 
Institute, a 6000 member management training group, to select in- 
dividuals who were unquestionably leaders in Irish Economic life. 

The use of eminent people in the study of creativity raises 
the question of whether studying creativity in the highly gifted 
Is tantamount to studying creativity in "normals." Although most . 
researchers have treated creativity as a normally distributed trait 
the argument that it is limited to .i very small segment of the 
population is a worthwhile consideration. 
Self-Reported Creative Activities and Achievements 

Perhaps the most easily defensible way of identifying creative 
talent is in terms of self-reported creative activities and achieve 
ments. Although there is a problem in deciding which activities 
and achievements should be designated as creative, most of the 
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lists that have been used in research have a reasonable degree 
of face validity. Creative activities can take place in a num- 
ber of fields which are recognized by society as important. In 
studying talent for the National Merit Scholarship Corporation, 
Holland and Nichols (1964) describe lists of achievements and 
activities in science, art, literature, music, etc. The achieve- 
ments described by Holland are rare, demand commitment, and are 
generally publicly recognized through prizes, publications, etc. 
For example, some illustrative items are: placed first; second 
or third in a regional or state science contest; exhibited or 
performed a work of art; had poems, stories or articles published 
in a public newspaper; invented a patentable device; had minor 
roles or leads in plays produced by a college or university. Re- 
search incorporating this type of checklist has been published in 
a number of studies (Holland & Astin, 1962; Holland & Baird, 1968; 
Holland & Nichols, 1964; Holland & Richards, 1965; Richards, 
Holland & Lutz, 1967a,b). 

Other lists similar in content and emphasis to the Holland 
list have been developed by Erikson (1966), Hocevar (1977), 
Torrance Cl969a,b). Skager, Schultz & Klein (1965) and Wallach and 
Wing (1969). In general, the total creativity score ir; simply 
the number of activities checked. Although these lists have been 
used In educational and psychological research, there are no cc 
merlcally available checklists. 

As stated earlier, these ten categories are meant only to 
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Identify somo common techniques for assessing creative talent. 
Because of the varied nature of research on creativity, there 
are other tests of creativity which are tailor made for specific 
situations, and do not easily lend themselves to categorization. 
A partial listing follows: Starkweather Creativity Tests (Stark- 
weather, 1971); Ideal Pupil Checklist (Torrance, 1975); Mosaic 
Construction Test (Hall, 1972); Barron-Welsh Art Scale (Barron & 
Welsh, 1952); Welsh Figure Preference Test (Welsh, 1959); Lund- 
steen Test of Creative Problem Solving (Rickborn & Lundsteen, 
1968); Onomatopoeia and Images (Khatena, 1969); Pennsylvania 
Assessment of Creative Tendency (Rookey, 1971); Group Inventory 
for Finding Creative Talent (Rimm & Davis, 1976); Ingenuity Test 
(Flanagan, 1968); and a series of cognitive measures developed by 
•researchers at Educational Testing Service (Frederiksen, Evans & 
Ward, 1975). In the next section some general problems and crit- 
icisms of the ten major approaches to the measurement of cre- 
ativity will be identified. 

Discussion and Critique 
A number of the approaches identified earlier require people 
(i.e., supervisors, peers, teachers) to make judgments about 
products, ideas or othei people. This technique presents a par- 
ticular problem since the researcher must decide who the judges 
should be and what the judges should be looking for. To illus- 
trate, when judgments of art products are made, there is some 
evidence that experts and nonexperts dlea^ (GoJann, 1963; 
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Knapp & Wulff, 1963). Skager, Schultz and Klein (1965) have 
identified at least three different points of view regarding art 
judgments. Despite studies like these, the inter judge reliabil- 
ities reported in most creativity research is moderately high 
(e.g., Bartlett & Davis, 1974; Gough, 1976; Karlins, Schuerhoff 
& Kaplan, 1969; Moss & Duenk, 1967; Skager, Schultz & Klein, 
1965; Wallen & Stevenson, 1960;'ward & Cox, 1974). As a potential 
solution to problems of interjudge reliability, a strategy for the 
£ priori selection of homogeneous judges in a product-centered 
approach to creativity has been developed by Korb and Frankiewicz 
(1976). 

Related to the problem of interjudge reliability is the prob- 
lem of how the judges are asked to formulate their decisions. Not 
surprisingly, different researchers ask their judges to con£,.dpr 
different criteria. The list of criteria is virtually unending, 
including fluency, originality and other cognitive characteristics, 
personality traits, self-expression, enthusiasm, productivity, and 
expertise. Some investigators use elaborate definitions of cre- 
ativity; others use no definition at all. Furthermore, there is 
no guarantee that judges will understand and be guj.ded by the 
sometimes complex definitions, and there is little research that 
shows the instructions even make a difference. To the contrar>', 
when Drevdahl (1956) compared defined and undefined conditions 
With teacher nominations, no significant differences in the judg- 
nents of their most creative students were found. Similarly, 



19 



Measurement of Creativity 

18. 

Karlins et al. (1969) reported a correlation of .97 between de- 
fined and undefined ratings of creativity. 

Another issue is the discriminant validity of judgments. It 
is reasonable to expect that judges are able to distinguish cre- 
ativity from other constructs such as intelligence, achievement, 
competence, etc. A review of some appropriate studies indicates 
otherwise. Holland (1959) had teachers, principals, and guidance 
counselors rate students on twelve traits, including originality. 
Originality correlated .72 with speaking skills and .84 with 
writing skills. The other nine correlations which involved origi- 
nality ranged from .50 to .65. Wallen and Stevenson (1960) in- 
vestigated creativity in fifth grade writing' and found that the 
teacher's judgments correlated .57 with IQ, .66 with school grades, 
and from .66 to .72 with three standardized achievement tests. In 
a study of research personnel, instructor ratings of creativeness 
correlated .68, .72, and .75 with grades, an officership rating 
and a logical reasoning rating, respectively (Muliins, 1964). 
Finally, in a study involving faculty ratings of creativity in 
architecture, Karlins et al. (1969) found that ratings of cre- 
ativity correlated from .79 to .95 with ratings of dependability, 
adaptiveness , need to know, independence, and productivity. 

Regarding art judgments, the overall results are. even more 
striking. Brittain & Beittel (1964) found that creativity scores 
determined by judgments on three art performances were correlated 
.89 with judged aesthetic quality. Csikszentmihalyi and Getzels 
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(1970) found that the originality ratings of a number of drawings 
correlated .76 with a rating of technical skill and .90 with a 
rating of overall aesthetic value. Similarly, in the Getzels and 
Csikszentmihalyi (Note 1) study, mean ratings on originality cor- 
related with mean ratings on artisti. potential .72 for males and 
.77 for females. Finally. Rossman and Gollob (1975) report that 
among art students, peer ratings of creativity correlated .84 with 
peer ratings of intelligence. Likewise, faculty ratings of cre- 
ativity correlated .59 with faculty ratings of intelligence. 

Since Judges have trouble discriminating creativity from other 
attributes, it follows that they will have even more trouble dis- 
criminating various dimensions of creativity. In the study cited 
earlier. Foster (1971) reported that the correlations between flu- 
ency, flexibility, and originality ratings were about .80 in phys- 
ical education, painting, model-making, writing and drama. On the 
same line, Yamamoto (1964b) found that when peer nominations were 
used to measure flu-.ncy. flexibility and inventive level, their 
Intercorrelations ranged from ^62 to .82. 

Notably, all of these intercorrelations would be even higher 
If the data were free of measurement error (i.e... unreliability in 
the Judgments). It is obvious that a considerable "halo" effect 
Is present when creativity is based on subjective Judgments. 
Judges see:, to only be able to establish some overall opinion 
which Influences all of their Judgments. Because of this, they 
fail to discriminate creativity. The 'ence Indicates that 
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asking judges to choose the most intelligent people or their 
favorite product is probably equivalent to obtaining judgments 
of creativity. There is one exception to this general finding. 
Rossman and Gollob (1975) have demonstrated that subjects can 
laake distinct judgments regarding creativity and intelligence 
when the judgments are based on diverse information. Specifi- 
cally Rossman and Gollob gave their raters abilities informa- 
tion, personality information and biographical information. It 
is Important to note that the raters in the Rossman and Gollob 
(1975) study did not know the individuals that they were rating, 
thus, making objective judgments more likely and the "halo" ef- 
fect less likely. 

Another disturbing characteristic of most of the techniques 
for measuring creativity is the almost total neglect of the di- 
mensionality of the attribute. In most instances, creativity is 
thought of as a unitary trait — there is little differentiation 
among creativity in the arts, sciences, literature, etc. Yet, in- 
tuitively it is plausible that a person who is creative in one 
area has neither the time, ability, nor the motivation to be cre- 
ative in other arpas. To date, this hypothesis has been the major 
focus of only two studies (Hocevar, 1976; Jones, 1964) despite its 
obvious iu-portance to theoretical and practical concerns. It is 
almost certain that the personality and intellectual correlates of 
creativity would be moderated by the area under consideration. In 
addition, there is the practical problem of predicting creativity 
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In different areas, since different instruments should probably 
be used for different areas. Although the need for more research 
on the role of creativity in different areas has been expressed 
(Mc^<,u^ar, 1964; Thorndike, 1966), there has been little effort 
in this direction. 

The most condemning problem associated with the measurement 
of creativity is the lack of convergent validity among different 
methods. Each of the previously defined approaches is a widely 
used and accepted technique for identifying creative talent. Since 
each method is purported to be measuring creatJvity, it is reason- 
able to predict that they be correlated, thus satisfying a minimum 
condition of convergent validity. 

In a study of 166 scientists in a government laboratory, 
Taylor, C. , Smith and Ghiselin (1963) collected scores on 52 cri- 
teria of creativity including eleven supervisor ratings, six peer 
ratings, autobiographical information and numerous product vari- 
ables. While scores based on the same method (e.g., the eleven 
supervisor ratings) tended to be highly related, scores obtained 
from different methods were not. For example, supervisor ratings 
had a low relationship to peer ratings, and self-rating scores 
were uncorrelated with the more objective autobiographical data. 
Furthermore, scores based on products such as publications and 
reports were not related to either supervisor or peer ratings. 
When factor analyzed, this array of criteria yielded a total of 
fourteen relatively independent categories. 
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DaviB and Belcher (1971) compared four methods of identifying 

» 

creativity— two tests of divergent thinking, a biographical in- 
ventory, and a criterion which was composed of self-rar.ings on 
several creative activity questions. Except for the relationship 
of the biographical inventory and the criterion, the intejrcorrela- 
tions of these tests were low and generally nonsignificant for 
both males and females. 

In their study of art students, Getzels and Csikzentmihalyi 
(Note 1) included fourteen measures of creativity, including two 
teacher ratings, eight tests of divergent thinking, two person- 
ality inventories (Cattell's 16 Personality Factors and the Study 
of Values), grades, and IQ scores. The authors predicted some 
overlap between these criteria since they all have some claim as 
Indices of creativity. Such was not the case, a factor analysis 
revealed only method factors rather than a general creativity 
factor. In another study of art students, Ellison (1973) found 
low and negative relationships between judged creativity on a 
pastel drawing and the Remote Associations Test and Barron-Welsh 
Art Scale, 

Finally the correlations of divergent thinking with other 
measures of creativity have been inconsistent with some investi- 
gators finding a positive relationship (Bartlett & Davis, 1974; 
Bennett, 1973; Cropley, 1972; Dewing, 1970; Halpin, Halpin & 
Torrance, 1974; Haven, 1965; Hocevar, Note 2; Jones, 1964; Milgram 
i Milgram, 1976; Rotter, Langland & Berger, 197J; Torrance, 1969a, b 
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Wallach & Wing, 1969; Wallbrown & Huelsman, 1975; 
Zegas, 1976) and other investigators finding no relationship 
(Andrews, 1975; Barron, 1969, p. 86; Beittel, 1964; Erittain & 
Beittel, 196/^; Dillehunt, 1973; Getzels & Csikszentmihalyi, 
Note 1; Gcolsby & Helwig, 1975; Gough, 1976; Hadden & Lytton, 
1971; Jordon, 1975; Karlins et al. , 1969; Kogan & Pankove, 1974; 
Popperova, 1972; Roweton, Farless, Donham, Wleklinski & Spencer, 
1975; Skager, Klein & Schultz, 1967). Further, in studies where 
significant positive correlations have been reported, the correla- 
tion is seldom higher than .30, suggesting that the two measures 
only have ten percent of the variance in co^on. 

When creativity is identified using^iutiple methods, indi- 
viduals are ranked differently. High scorers on one method are 
not necessarily high scorers o*( another. This finding ^^ises\ 
questions as to whether the tJait of creativity is^necessary 
psychological construct. 

Besides these theoretical problems associated with construct'x" 
validity, the lack of convergent validity has another Important | 
implication. Any study of creativity is severely limited by its 
assessment method. In other words, researchers should limit their 
conclusions to populations chosen by the same method. 

A possible answer to this confusion is that many of the methods 
which have been tagged with the creativity label do not really 
measure creativity. At least, they do not measure the behavior 
that society typically labels creative. In many cases, the laethods 
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assumed correlates of real life creative behavior. Guilford and 
the cognitive group have assuiped that divergent thinking *is some- 
how linked to creative behavior. The personality psychologists 
have assumed that some traits are linked to creative behavior. 
And others have assumed that attitudes and interests or past 
experiences are linked to creative behavior. Although there is 
some evidence to support the validity of these assumptions, the 
relationship of these measures to real life creativity is not one 
to one. Therefcre, their uncritical use as measures of cre- 
ativity is not warranted. 

An important distinction needs to be made concerning the goals 
of creativity research. It must be emphasized that different re- 
searchers have studied different aspects of creativity and that 
often these cross-purposes have been reflected in the measuring 
process. Tests of cognition, attitudes, interests, personality, 
biography, etc. are appropriate when the researcher's goals are 
to explain something about creativity, but they ere not acceptable 
in the selection process. High scorers on these tests are not 
necessarily creative people. If a researcher is intetested in 
the personality correlates of creativity or in the relationship 
of intelligence to creativity, or in evaluating certain educa- 
tional programs designed to enhance creativity, why not go 
directly to the observable criteria? This can best be accom- 
plished through studying emincnj: individuals or usinp an inven- 
tory of creative activities and accomplishments 
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Since studies of erainent men are often impractical, the con- 
clusion presented here is that an inventory of creative activi- 
ties and accomplishments is our best measure of creativity. The 
kind of activities listed in the Holland and Nichols (1964) in- 
ventory are recognized by society as being creative, and they 
are relatively rare. The activities demand a high degree of 
commitment and they are not something that ."^ust anyone can 
master. 

Furthermore, it is asserted here that a useful way to measure 
creativity is to simply ask the subject. This is not a profound 
position, but yet the procedure is rarely used. The predominant 
preference in the field today is to identify creativity by in- 
direct methods (i.e., predictors) Lhat essentially have little 
to do with the real criteria of creativity. 

Asking the subject has one further advantage. The subject, 
in most cases, knows more about himself than peers, supervisors, 
teachers, etc, Earljer it was argued that other individuals can 
not always discriminate creativity from their own general opinion 
of the .subject. On the other hand, the subject himself should 
have a good idea of his creative ability in a wide variety of 
areas. Furthermore, when compared to observer ratings and other 
assessment procedures, self-reports have been found to be superior 
In the measuremiMU of many psychological traits (MischeJ, 1968)- 

An inventory of creative acclvltles and achievements £»lso has 
predictive: utility. Pa^it behavior is generally the best, predictor 
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of future behavior. The efficacy of this predictive strategy is 
evident in a number of areas (see Mischel [1968J for a review). 
These findings appear to generalize to the area of creative be- 
havior. MacKinnon (1968) reports that, in studies of creative 
persons in a variety of fields, earlier accomplishments were con- 
sistently predictive of later accomplishments. 

The most compelling evidence for predicting future creative 
behavior with past creative behavior is frund in two related 
studies (Holland & Nichols, 1964; Richards. Holland 6 hutz, 196;a). 
In a high aptitude sample, Holland and Nichols predicted talented, 
nonacademic accomplishment in six areas: leadership, science, 
dramatic arts, literature, music and art. Predictors included 
interests, goals, activities, self-conceptions, aptitudes, and 
personality traits. The results of this study indicated that 
past activities and achievements v -re easily the bast predictors 
of creative achievement in college. The findings of this study 
have been replicated with a less select sample by Richards et al. 
(1967a). 

To conclude, peer nominations, supervisor ratings, teacher 
nominations, and judgments of products are often inadequate in- 
dicators of creativity due to the rater's inability to discrim- 
inate creativity from other traits. Divergent thinking, bio- 
graphical characteristics, u ... i , ades)and interests, and person- 
ality characteristics are best described only as correlates of 
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direct measures of creativity. In addition, most approaches gen- 
erally fail to discriminate creativity in one area from creativity 
In another area. Thus, despite the voluminous literature on the 
measurement of creativity, e simple and straightforward inventory 
of creative achievement and activities appears to be more de- 
fensible than the more commonly used methods. 
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